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Abstract 

In this paper, we analyze the uniqueness of the sparse time frequency decomposition and 
investigate the efficiency of the nonlinear matching pursuit method. Under the assumption 
of scale separation, we show that the sparse time frequency decomposition is unique up to 
an error that is determined by the scale separation property of the signal. We further show 
that the unique decomposition can be obtained approximately by the sparse time frequency 
decomposition using nonlinear matching pursuit. 
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1 Introduction 

Nowadays, data play more and more important role in our life. It has become increasingly 
important to develop effective data analysis tools to extract useful information from massive 
amount of data. Frequency is one of the most important features for oscillatory data. In 
many physical problems, frequencies encode important information of the underlying physical 
mechanism. Many time-frequency analysis methods have been developed to extract information 
of frequencies and the corresponding amplitudes from the measurement of signals. These include 
the windowed Fourier transform, the wavelet transform mm, the Wigner-Villc distribution 
m, and the Empirical Mode Decomposition (EMD) method [2J[TT] . Among these different time- 
frequency analysis methods, the EMD method provides an efficient adaptive method to extract 
frequency information from nonlinear and nonstationary data and it has been successfully used 
in many applications. However, due to its empirical nature, the EMD method still lacks a 
rigorous mathematical foundation. Recently, a number of attempts have been made to provide 
a mathematical foundation for this method, see e.g. the synchrosqueezed wavelet transform [5], 
the Empirical wavelet transform [8], the variational mode decomposition ta¬ 
in the last few years, inspired by the EMD method and compressive sensing p] [2j, .7], Hou 
and Shi proposed a novel time frequency analysis method based on the sparsest representation 
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of multiscale data [14] . In this method, the signal is decomposed into a finite number of intrinsic 
mode functions with a small residual: 

M 

m = £ dj(t) cos Oj(t) + r(t), tel, (1.1) 

3 =i 

where a,j(t), 0'-(i) >0, j = 1, ■■■, M and r(t) is a small residual. We assume that <Zj(t) and 
Qj are less oscillatory than cos 0j ( t ). What we mean by “less oscillatory” will be made precise 

below by the definition of scale separation property of the signal. Borrowing the terminology 

from the EMD method, we call a 7 (t) cos O-j(t) the Intrinsic Mode Function (IMF) [5]. After the 
decomposition is obtained, the instantaneous frequencies u>j(t) are defined as 

u j {t) = e' j {t), (i.2) 

and the amplitude is given by a,j (t) . 

One main difficulty in computing the decomposition CCD is that the decomposition is not 
unique. To pick up the ’’best” decomposition among all feasible ones, Hou and Shi proposed 
to decompose the signal by looking for the sparsest decomposition by solving the following 
nonlinear optimization problem: 

Minimize M 

(“i)l<KMi(®k)l<KM 

M (1-3) 

Subject to: || /- ^ a k cosflfc || L 2 < e, a k cosO k £V, 

k =1 

where e is the noise level and T> is the dictionary consist of all IMFs (see m for its precise 
definition). 

The idea of looking for the sparsest representation over the time frequency dictionary has 
been exploited extensively in the signal processing community, see, e.g. M. Comparing with 
other existing methods, the novelty of the method proposed by Hou and Shi is that the time 
frequency dictionary being used is much larger. This method has the advantage of being fully 
adaptive to the signal. 

The optimization problem (11.311 is nonlinear and nonconvex. It is challenging to solve this 
nonlinear optimization problem efficiently. To overcome this difficulty, Hou and Shi proposed 
an efficient algorithm based on nonlinear matching pursuit and Fast Fourier transform to solve 
the above nonlinear optimization problem. In a subsequent paper m, the authors proved the 
convergence of their nonlinear matching pursuit algorithm for periodic data that satisfy certain 
scale separation property. Further, they have demonstrated the effectiveness of this method by 
decomposing realistic signals arising from various applications. However, from the theoretical 
point of view, one important question remains open. That is the uniqueness of the solution of 
the optimization problem (11.31) . This is precisely the main focus of this paper. 

In this paper, we will show that under the assumption of scale separation, the solution of 
optimization problem (11.31) is unique up to an error determined by the scale separation property. 
First, we give a precise definition of scale separation of a signal as follows: 

Definition 1.1 (scale-separation). One function fit) = a(t) cos0{t) is said to satisfy a scale- 
separation property with a separation factor e > 0, if a{t ) and 0{t) satisfy the following condi- 
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tions: 


a(t ) G C' 1 (R), 9eC 2 


inf O' it) > 0, 

te R 



a'it) 

< 6, 

0"(t) 

mf teR 0'(t) 



o mY 


< e, Vt G R. 


In the above definition, the first three assumptions are on the regularity of the envelope aft) 
and the instantaneous frequency O'ft). This regularity is relatively mild and can be relaxed to a 
piecewise smooth function. The key assumptions on the scale separation property are the last 


two assumptions. The assumption 


a '(«) 

«'(*) 


< e quantifies what we mean by the envelope is less 


oscillatory than the normalized signal cos (Oft)). The last assumption 


s"(t) 


< e essentially 


says that the frequency oscillation is relatively weak compared with the square of the frequency 
itself. In the previous theoretical study of time-frequency analysis, a much stronger assumption 

r\ll 

on the frequency oscillation is made, i.e. -p- 
consider, the instantaneous frequency O'(t ) is typically quite large. Therefore, the assumption 


< e, see e.g. 00- In the problems that we 


B"(t) 


9 " 


< e. 


(g,( t )) ir[ < e is much weaker than the typical assumption, 

With the definition of scale separation, we construct the dictionary T> t by putting all the 
functions satisfying scale separation together. 


V e := (a(-) cos Of) : (a, 0) G U e } , 


(1.4) 


where 


U e := 


j(a,<9) : a > 0,(9' > 0; 


a' 

< e. 

0" 

O' 


i^'J 2 


suptgn 6'{t) 
inftgR 0'(t) 


= M' < +00 


(1.5) 


is the dictionary that we will use to represent the signal. For any given signal /(t), we 
decompose / over the dictionary T> e by looking for the sparsest representation: 


Minimize 
subject to 


M 

M 

i/w-E a k (t) cos0 k (t)\ < e 0 , 
fe=l 

a k {t) cos 9k(t) G T> e , k = 1,2,- ,M. 


(Po) 


Here eo is a given threshold of the accuracy of the decomposition. Typically, eo is set according 
to the amplitude of noise. 

To get the uniqueness, we need to assume that the signal /(f) is well separated which is 
defined in Definition P 

Definition 1.2 (Well-separated signal). A signal f : R — > R. is said to be well-separated with 
separation factor e and frequency ratio d if it can be written as 

M 

/(*) = £ a k (t) cos0 k (t) + r(t) (1.6) 

k =1 

where all f k (t ) = a k (t) cos 6 k (t) satisfies the scale-separation property with separation factor e, 
r(t) = 0(e o) and their phase functions 0 k satisfy 


e’ k (t) > vt g r, 


(1.7) 


and d > 1, d — 1 = 0(1). 
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In the above definition, the key measurement of separation among different components is 
the value d , which measures the frequency gap among different components. For a well separated 
signal, we can prove that the solution of the optimization problem ( [Pol ) is unique up to an error 
0(e). The main result is summarized in Theorem ll.il 

Theorem 1.1. Let f(t) be well separated with separation factor e <C 1 and frequency ratio d as 
defined in Definition U.A Then (a*,, d k ) 1<k<M is an optimal solution of the optimization problem 
flP 0 D and it is unique up to the error e, i.e. if (d k , O k ) is another optimal solution of 

flPoD . then M = M and 

\a k (t)-d k (t)\=0(e), Ml_^M = 0(e), Vi, k = l,---,M. (1.8) 

This theorem is proved by carefully studying the wavelet transform of each IMF. The details 
of the proof can be found in Section 2. 

We remark that there has been some very nice progress in developing a mathematical frame¬ 
work for an EMD like method using synchrosqueezed wavelet transforms 0 and windowed 
Fourier transform [4] . These methods are based on continuous wavelet transform and windowed 
Fourier transform respectively and do not look for the sparsest decomposition directly. So the 
question of uniqueness is not the same as that we consider here in this paper. 

The rest of the paper is organized as follows. The uniqueness of the sparse time-frequency 
decomposition is analyzed in Section 2. In Section 3, we analyze the performance of an algorithm 
based on matching pursuit. Some concluding remarks are made in Section 4. We defer a few 
technical lemmas to the appendices. 


2 Uniqueness of \Pq\ for well-separated signals 


In this section, we assume that the signal, /(i), satisfies the scale-separation property with 
separation factor e and frequency ratio d as defined in Definition 11.21 

For this kind of signals, the existence of the solution of ( [Po| ) is obvious. Since f(t) already 
has a representation, 

M 

f(t) = ^2 a k (t) cosO k (t) + r(t), (2.1) 

k =1 

this gives a feasible decomposition. Each feasible decomposition gives a positive integer, by 
collecting all these positive integers together, we get a set A. Then we know that A is nonempty 
and has a lower bound. Let Mg = inf A. Since A consists of positive integers, then Mg = inf A 
can be achieved. Then the existence of the solution of flPoD is proved. 

But the uniqueness is much more complicated. In the next subsection, we will prove that if 
/ is a well-separated signal with separation factor e and frequency ratio d > 1 and e -C 1, then 
the solution of flPp| ) is unique up to e and eo- 

To simplify the notation, in the rest of this paper, we assume eg and e have the same order 
and denote both of them by e. 

We prove Theorem 11.11 by carefully studying the wavelet transform of each IMF. As we 
show in Lemma 12.11 the continuous wavelet transform (CWT) of each IMF is confined in a 
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narrow band by properly choosing an appropriate wavelet function. Then the uniqueness can 
be obtained by comparing the continuous wavelet transform of different decompositions. 

In order to complete the proof, first, we need to estimate the width of CWT of each IMF. 
This estimation is given in the following lemma. 

Lemma 2.1. let ip is a wavelet function such that 

h= |0(T)|dr < +oo, h= \rip' (r)|dr < +oo, / 3 = / |r 2 ^ ,, (r)|dr < +oo. 

J M J K J K 


Suppose (a, 0) € U e , i.e. 


then we have 


a' 

< e. 

0" 

O' 


[O'Y 




W(ae hj) = —= [ a{r)e d t = y/uja(t)e l9 ^ ip{yj6'(t)) + Cy/uje 

v 0 -’ Jr V w / 

where C = (A + 4|a(t)| + 1)I± + [. M' + (. M' + l)|a(i)|] I 2 + M'\a{t)\I^ and A = sup (gR |a(t)|. 
The proof of this lemma can be found in Appendix A. 


Remark 2.1. One sufficient condition to make sure that /i,/ 2,/3 < +00 is that the Fourier 
transform of the wavelet, %p 6 C 4 (R) and has compact support. In the proof of Theorem 11.11 
we use the wavelet whose Fourier transform is a fifth order B-spline function such that above 
sufficient condition is satisfied. 


2.1 Proof of Theorem 11.11 

Now, we are ready to give the proof of Theorem ll.il 
Proof, of Theorem \l.l\ 

The details of the proof may be a bit tedious but the idea is very clear. First, we assume 
there are two decompositions: 

M M 

f(t) = ^2 a k{t)cosO k (t) + O(e) = ^2 a k (t) cos Ok (t) + O(e). (2.2) 

fc=l k- 1 

Using Lemma T2.II we have 

M M 

u>~ 1/2 W(f)(t,uj) = '22 a k(t) e ~ iek( - t): ip{uj0 , k (t)) + 0(e) = ^2d k (t)e- l0k{t): ip(ujO' k (t)) + 0{e). (2.3) 

k= 1 k= 1 

By analyzing the support of W(/)(£,u;), we can get M — M and 

a k (t)e- ie *W$(uO' k (t)) = a k {t)e- i9 ^2{u0' k {t)) + O(e), k = 1, • • • , M. (2.4) 

Using these equalities, we can show that m is true. 

First, we pick up a specific wavelet function ip. We require that its Fourier transform ip £ C 4 
has support in [1 — A, 1 + A] with 0 < A < and '0(1) = 1 is the maximum of \ip\. In this 
proof, we choose ip to be a fifth order B-spline function after proper scaling and translation. 
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For any 6 £ C 1 , define 

U e = {(i,w) e K 2 : > e} , U e (t) = jw € K : $(w0'(t))| > e} . 

Now, fix a time t = to G [0,1], for any l G {1, • • • , M}, let = e>(t 0 ) • Using (|2.3|) . we have 

M 

uj~ i/2 W(f)(t 0 ,uJi,o) = '^2a k {to)e~ iek< ' to) ^(e , k (to)/d , l {t 0 ))+0(e) 

k =1 
M 

= Y,' a ^~ Z§kito) M(t 0 )/e / l (t 0 )) + O(e). ( 2 . 5 ) 

fc=l 

Since ^(^o)/^(^o) < 1/rf <1 — A or 0 r k (to)/0i(to) > d > 1 + A for any k ^ /, in the first 
summation of the above equation, we have only one term left, 

M 

ai (t 0 )e- ie ^^(l) = J2 a k (t 0 )e- iS ^(e' k (to)/e[(to^ + O(e). (2.6) 

fc =1 


Then, there exists at least a I(l, to) € {1, ■ • • , M}, such that 


V’(^/(j,t 0 )(^o)/^i(^o)) 


> 0 , 


(2.7) 


which means that 1 — A < tijj (to)/0'(to) < 1 + A. Using the assumption that / is well- 

separated with frequency ratio d and 0 < A < , for any k ^ l, we obtain 


This gives that 


or £M<I 

Wo) - : Wo) ~ d- 






Wo) 0’ k {to) 


> d(l — A) > 1 + A, 


( 2 . 8 ) 


(2.9) 


or 


w 

Then, for any k ^ l, we have 


e 'ni,t 0 )^o) _ S 'i(i,t 0 )( to ) Wo) K 1 + A < 1 _ A 


<Wo) W 


( 2 . 10 ) 




= 0. 


( 2 . 11 ) 


This implies that I(k,to) ^ 1(1,to), k^l. Then we get that 


Since 


(dfc, 


M> M. 


is a solution of (|/b[). we also have M < M. This implies that 

Kk<M — 


( 2 . 12 ) 


M = M, 


(2.13) 


and for any t € [0,1], /(•, t) : {1, • • • , M} —> {1, ■ ■ • , M} is a one to one map. Then, we can 
define its inverse map / _1 (-, t ) : {1, • • • , M} —> {1, • • • , M}. 
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For any k = I,-- - , M, we study the function : [0,1] — > {l,--- ,M}. Using the 

condition that < e and the signal / is well-separated, it is easy to see that I~ 1 (k , •) is a 
constant over [0,1], i.e. 

J- 1 (jfe,t)=7- 1 (jfe,0), Vie [0,1], fc= l,--- ,M. (2.14) 

Otherwise, suppose there exists to e [0,1], such that I~ 1 (k,t q) ^ l~ 1 (k,0). Let A = {0 < t < 
t a : I~ 1 (k,to) = ^ _1 (fc,0)} and £ = sup A. Then for any 77 > 0, there exist t 1} t 2 e [0,1], such 
that 

ii < £ < t2, |i2-ii|<f?, I~ 1 (k,0) = I~ 1 (k,ti) ^ / _1 (fc,i 2 )- 


Denote 


/ 1 (k,t 1 ) = ki, I 1 (k,t 2 ) = k 2 , ki^k 2 . 
Then, by the definition of the map J(fc,i), we have 


(2.15) 


1 - A < 


KM . 1 , A 1 A . **&) 


<l + A, 1 — A < 


< 1 +A. 


^(* 1 ) ' 

Without loss of generality, we assume that ff k > ff k . Then, we have 

O'kiti) < (1 + A)^(ii), e' k (t 2 ) > (1 - A )e' k2 (t 1 ). 

Now, let 77 —>• 0, have ii, t 2 —> £, which gives 

e' k {0 < (1 + A)e' kl ( 0 , o' k (0 > (i - a)^). 

On the other hand, since / is well-separated, we know that 




< 1/d. 


Then, we have 

0' k (O < (1 +A)£K fci (0, > d( 1 - A)0' ki (O > (1 + A)6' kl (0, 

which is a contradiction. This means that / _ 1 (fc, •) is a constant over [0,1] and we can assume 
/ _1 (fc, t) = k, Vie [0,1], k = l,--- ,M. (2.16) 

Now we have that 


1 - A < 


m 

m 


< l + A, Vie [0,1], k= 1, 


, M. 


(2.17) 


Using the assumption that the signal / is well-separated with ratio d and the choice of if), we 
have that for any k, Z = 1, - • - , M, k ^ l 


^M[(i)) = $ (w0[(i)) = 0, V(i,w) e Ue k , 
$ M)(i)) = ^(w0[(i)) = 0, V(i,w) e U §k . 
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(2.18) 

(2.19) 






On the other hand, using Lemma l2.ll we have 


M 


M 


W = ^a k (t)e l6k{t ^{L 0 d' k (t)) + 0{e) = ^a k (t)e l6k{t): ip{u0' k (t)) + O(e)( 2 . 20 ) 


fc= 1 


k =1 


Using the three relations (|2.18|) . (j2.19|) and (|2.20j) , we have 

a k (t)e- i0 ^^(coe' k (t)) -a fc (t)e-^ ( 4 ) ^MUt))| = 0(e), V(t, W ) € ( 2 ' 21 ) 

which implies that 

a k (t)ip(u)0' k {t)) - ak{t)i>(wO' k (t)) = 0(e), V(i,w) G Ue k (J . ( 2 . 22 ) 


Next, we will prove that |afc(i) — afc(£)| = O(e) and 1 0' k (t) — 0' k (t)\ = 0(e) from (12.221) . First, we 
consider the envelopes a k and a k . 

If a k (t) > a k (t), we choose w = \/8' k (t) to get 


akit) V>(1) -a k (t) ^{9' k {t)/9' k (t)) = 0 (e), 


(2.23) 


where we have used the fact that 
we have 


0 < 


ip(£) achieves its maximum at £ = 1. Since a k {t) > a k {t), 

(2.24) 


^(1) K(£) - a k (t)) < a k (t) ip(l) -d k (t) ip{8' k (t)/6' k (t)) = O(e). 

This proves that 

a k (t) — a k (t) = O(e). (2.25) 

If a k (t) < a k (t ), we take w = 1/Q' k (t). By following a similar argument, we can prove 

a k (t) - a k (t) = O(e). (2.26) 

Combining these two cases, we obtain 

|o/fc(t)-5fc(t)|=0(e). (2.27) 

Substituting the above relation to (12.221) . we get 

- \^K(t))\ = 0(e), V(t, w ) G U^v ( 2 - 28 ) 

For any t G [0,1], let u = (1 — A/2 )/9' k (t), then wc have 

^(1 - A/2))| - [(1 - A/2 )9' k {t)/8' k {t)\ | = 0(e). (2.29) 

Since ip is a fifth order B-Spline function and e <C 1, it is easy to see that there exists a constant 
C > 0, such that 


(l-A/2) (e' k {t)/6' k {t) 


-1 


< Ce. 


(2.30) 


Since ip(u>) is a fifth order B-Spline function, ip{u>) is symmetric with respect to ui = 1. Thus 
we have ■/>(! — A/2) = ^(1 + A/2). Then, there is also another possibility: 


(1 - A/2 )6' k (t)/0' k (t) - (1 + A/2) < Ce. 


(2.31) 












































If (12.301) holds, then we get 


If (12.311) holds, then we have 


m)-m i 

m 


0(e). 


(2.32) 


^) > l + A/2-Ce 


m 


1 - A/2 


where we have used the assumption that eCl. 
Then, let u= \/0' k (t) in (12.28[) . we have 


1 = 


■ 0 ( 1 ) - $ (d'k(t)/0'k(t)) =0(e). 


This argument shows that (12.311) cannot be true. This completes the proof. 


(2.33) 


(2.34) 

□ 


2.2 Discussion on Signals with close frequencies 

In this section, we will give a brief discussion on the signal with close frequencies, i.e. the 
frequency ratio d —> 1 in the definition of well-separated signal. 

In the proof of Theorem ll.il the frequency ratio d seems to be arbitrary, as long as it is larger 
than 1. Actually, the distance between d and 1 can not be too small. The gap is determined by 
the separation factor e. First, it is easy to show that the integrals Ji, I 2 l l 3 in Lemma [All satisfy 

h=0{ A^ 1 ), I 2 =0( A" 2 ), I 3 = 0( A" 3 ). (2.35) 

When d approaches 1, A = becomes smaller, then /i, I 2 , I 3 become larger. When Ji, I 2 ,I 3 

is as large as 1/e, Lemma [2TT1 breaks down, which in turn leads to the break down of the proof 
of Theorem 11.11 

On the other hand, the frequency ratio is defined pointwisely. As long as there exists a point, 
such that the frequency ratio at this point is away from 1 comparing with e, the argument before 
(12.131) of the proof of Theorem ! l.ll still applies, which means that the decomposition given in (11.61) 
is still an optimal solution of the optimization problem QPp[ ). But in this case, the uniqueness 
is not guaranteed. To illustrate this point, we construct an example such that the solution of 
QPol ) is not unique. 

f(t) = cos0i(t) + cosd 2 (t), t £ [0,1], (2.36) 


9±(t) = 6 nkt + kn, 0 2 {t) = 8 nkt + k sin 2nt, (2.37) 

where k is a positive integer. We can choose k large enough, such that cos , cos 0 2 £ U e . At 
t = 0, 0£(O)/0i(O) = 4/3. From the discussion above, we know that (12.361) gives a solution of 
( |PoP . On the other hand, it is easy to check that the following decomposition is also a solution 
of 


f (t) = COS 4>i(t) + COS (j) 2 (t), t £ [0, 1], 


(2.38) 


Mt) 


6 Trkt + kTT, t £ [0,1/2], 

0 o(t) 

8 nkt + k sin27rt, f£ (1/2,1], 


8 nkt + k sin 2 nt, 
Girkt + kn, 


t £ [0,1/2], 

t £ (1/2,1], 
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This example shows that when the frequencies intersect, the solution of ( ]Pp[ ) may not be unique. 
In this case, we need to impose some extra constraints to obtain uniqueness of the decomposition. 
One natural idea is to pick up the solution according to the regularity of a(t) and O'(t). The 
solution with smoother amplitude and frequency is favorable. One method based on this idea is 
proposed in [15] to decompose signals that do not have well-separated IMFs. In that method, 
the regularity is related with the sparsity over Fourier (or Wavelet) dictionary. In the above 
example, this method would prefer the decomposition (12.361) . since in this decomposition, both 
of the amplitude and the frequencies are very sparse over the Fourier dictionary. 


3 Optimal Solutions to the P 2 Problem 


Using the result in the previous section, we know that for signals that are well-separated, the 
solution of Q_Pq| ) is unique up to the separation factor e. One natural question is that how to 
find this unique solution. 

Based on matching pursuit, we propose the following algorithm to solve ( ]Pp| ) approximately. 
• r 0 = f, k = 1. 

Step 1: Solve the following nonlinear least-square problem: 


(ak,0k)& Argmin ||r fe _i - acos0||^ 2 

a,6 

Subject to: a,0 £ U e . 


(3.1) 


Step 2: Update the residual 

k 

rk = f ~ a j cos0j. (3-2) 

I=i 

Step 3: If ||rfc ||;2 < e 0 , stop. Otherwise, set k = k + 1 and go to Step 1. 

In the above algorithm based on matching pursuit, each IMF is given by solving the following 
nonlinear least-square problem: 

Minimize p(a, 0) := || f(t) - a(t) cos 0(t)||| 2 . 
subject to ( a,0)£U e . 

We would like to know that under what conditions on each IMF ak{t) cos 0k{t) of f(t) the above 
nonlinear least-square problem could provide a local (approximate) optimizer to the Pp problem. 

In the computations, we always deal with signals with finite time span. Without loss of 
generality, in this section we assume the time span of the signal is [0,1]. For the signal with 
finite length, it is unavoidable to introduce larger errors near the end points of the time interval. 
This is also known as the “end effect”. To simplify the analysis, we assume that the signal is 
periodic over [0,1]. For those signals that are not periodic, we first multiply a cutoff function 
to make the signal vanish near the boundary and then treat it as a periodic signal. This means 
that the analysis in this section is valid only in the interior region away from the boundary. 

For a periodic signal, we prove that each IMF is a local minimizer of ( IP 2 I ) as long as the 
signal satisfies some assumptions. This result is stated in Theorem 13.II 
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Theorem 3.1. Let f(t) be a function satisfying the scale-separation property with separation 
factor e and frequency ratio d as defined in Definition I l.Sic 

M 

/ft) = y^Qfcft) cos 6 k (t) +r(t), a k cos9 k G U e , a k = 0( 1), r = O(e). 

fe=i 

Suppose there exists a £ [1, d) and l £ {!,■■• , M} sitc/i that 


a ^O'^t) < O'{t) < aO[{t), Vie [0,1]. 


(3-3) 


If 


p{a, 9) < p{ai,0i), 


(3-4) 


where p{a , 0 ) ?s given in (|/b[) . i/ien we have 


Proof. First we know 


||acos 0 — ai cos 0 /IK 
IK cos 0i \\ L 2 


0(Ve). 


(3-5) 


0 > p(a,0) - p(ai,0i ) 

= 11/(0 ^ a(f) cos 0 (f) ||| 2 - ||/(t) -ai(t) cos 0 i(t )\\ 2 L 2 


y afc cos Ok + r(t) + a; (t) cos 0 ; (t) — a(t) cos 0 (f) 

2 

y, afc cos 0 fc + r(t) 

k^l 

L 2 

k^l 


= ||a; cos 0i — acos 0||| 2 + 2 (a; cos 0 ; — acos 0 , y a*, cos 0 fc + r(t)), 

k^l 


where the first equality follows from the definition of p(a,0) in flP 2 | ). In the rest of the proof, 
we try to control the second term of the above inequality. 

It is easy to verify that 


( ai cos 0;,y afc cos 0 fe ) 

< 

y hk,l K cos 0; || £2 |afc COS 0 k Wl 2 

k^l 


k^l 


= 5i||a/ cos 6 » z 11 2 , 


where 


Pk,l = 


[(a; COS 0i , Qfc cos 0 k ) | 

IK cos 0 i\\ L 2 \\a k cos 0 k \\ L 2 ’ 


Si 


= 

k^l 


||«fcCos 6< fc || L 2 

IK cos 0i\\ L 2 ' 


(3.8) 


Similarly, we have 


(a cos 0 , y afc cos Ok + r(t)) 
k^l 

<(5 2 ||aCOS0|| L 2|K COS0;|| L 2 

<<5 2 ||acos0- ai cos0/|K • |K cos 0/|| L 2 + <5 2 ||az cos0;|K, 


(3.9) 
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with 


C \\ a k cos Uk\\L 2 , \\r[t)\\ L 2 

^2 / t^k,l,a || ^|| 'll dll' 

“ \\aicos 9 i \\ L 2 \\at cos 6 i\\l 2 

| (a cos 0, a k cos 6 k ) | 

^ M ’“ \\acosO\\ L 2 \\a k cosO k \\ L 2 ’ 


Thus it follows from (13.61) . (13.71) and (13.91) that 


(3.10) 


0 > ||a; cos 0i — acos0||^ 2 — 2<5 2 ||acos0 — a; cos0z||/,2 • ||a; cos0/|| L 2 — 2(<5i + S 2 )\\ai cos0i||| 2 , 

(3.11) 

which implies 

" a c r - Tr ^^ w 
IK cos 0 i \\ l 2 V 

Here, p k d and /J, k ,i,a are just the coherences between a; cos 0i, acosO and a k cosO k . Under the 
assumption of scale separation and the assumption that different IMFs are well separated, the 
behavior of ai cost?;, acos0 and a k cos 0 k are close to that of the standard Fourier basis. Then, 
it is natural to expect that the coherences, [i k j, and Hk,l,ar> are small. Actually, the smallness of 
Hk,i and Hk,i,<x is given in Corollary 13.11 In particular, the estimate (13.201) from Corollary 13.11 
shows that for all k ^ l we have 


Fk,i = O(e), Hk,i, a = O(e). 
Together with the assumption that r(t) = 0(e), we get 

Si = 0(e), 82 = 0(e). 


It follows from (13.121) that 


This completes the proof. 


||acos0 — ai cos 0;|| L 2 
IK cos Oi \\ L 2 


0{y/e)- 


(3.13) 


(3.14) 


(3.15) 

□ 


In the proof of the above theorem, we have used the estimate (13.131) for p k j and pk,i,a- This 
estimate can be derived by the following lemma: 

Lemma 3.1. Let {a,0) £ U e be such that acosO has period 1. Then we have 

Q - 3e ) IK*)Hi* < IK*) cos0(t)|||, a < Q + 3e) |K*)IIl 2 - (3-16) 


Furthermore, if there is another pair ( a, 6 ) £ U e being periodic over [0,1] such that 

a. K*) 


te [ 0 , 1 ] 0 '(t) 


> 1, 


then we have 


I (a cos 0, a cos 0) I < 4e ( 1 + 


1 


( I -/?" 1 ) 5 


a(t)a(t)dt, 


(3.17) 


(3.18) 


12 
















The proof of this lemma can be found in Appendix B. Then (13.131) is just a direct corollary 
of the above lemma. 

Corollary 3.1. Let (a k ,9 k ), k = 1, ■ ■ ■ , M be well-separated with frequency ratio d and sep¬ 
aration factor e as defined in Definition 11.21 Let (a, 8) £ U t and there exists a £ [l,d) and 
l e { 1 , • • • , M} such that 


a _ 1 (9j(t) < 8'(t) < ad\(t), Vi €[ 0 , 1 ]. 

(3.19) 

Then for any 1 < k ^ l < M, we have 


\(a k cos 8 k , ai cos 8i)\ 

/^k,l • it /a || || /) || 

||ai cos 0 i\\ L 2 \\a k cos 0 fc || L 2 
| (a k cos 9 k , a cos 9) \ 

• || /j|| || q M ^\^/* 

||acos 6 »|| L 2 ||afc cos 0 k \\L 2 

(3.20) 

Proof. For any 1 < k ^ l < M, suppose 8' k > 9(. Since ( a kl 9 k ), k = 1,- 
separated, we have 

• ■ , M are well- 

min — y > d\ k ~ l \. 
te[o,i] 9( 

(3.21) 


Using Lemma T3. II it is easy to check that 

_ |(ofc cos 8 k ,ai cos 9f)\ _ (a k , ai) _ 

(■ a k ,ai) ||ai cos^H^ ||a fc cos0 fc ||i2 

I(gfc cos 9 k , ai cos 8 i)\ ||a-fcl|z,^ \\ai\\L 2 

(a k ,ai) \\a k cos 8 k \\ L 2 \\ai cosdi \\ L 2 

< 4e (I _ 3e ) (l + (1 _ d Vfc| )2 ) ' 

For any 1 < k ^ l < M, since (a k , 8 k ), k = 1, • • • ,M are well-separated and 

a~ 1 9' l (t) < 8'(t) < a8'i(t), Vie [0,1], (3.22) 


if 9' k < 8\, we know that 

> a~ 1 d l ~ k . (3.23) 

°k 

And if 9' k > 8[, we have 

^ > a~ 1 d k ~ l . (3.24) 

Then it follows from Lemma I3TT1 that, for k ^ l, 

< |(afc cos 9 k , a cos 8 )\ ||Qfc|| ||«||l^ 

f ' k ' La ~ (ak, a) \\a k cos9 k \\ L 2 ||acos 0|| L 2 

< 4 e Q_ 3e ) (i + ___L__). 

□ 
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Remark 3.1. We remark that in Corollary 13.11 and Theorem 13.II the condition (13.31) could be 
replaced by 


e'(t) d e' l+1 (t) d 
~ a ’ 0 '(f) ~ a’ 


Vt G [0,1]. 


(3.25) 


If we put a stronger assumption on the separation ratio d such that d > M' 2 (where M' is 
defined in Definition ll.il) . then we obtain the following theorem about the global minimizer of 
the P 2 problem. 

Theorem 3.2. Let f(t) be a function satisfying the scale-separation property with separation 
factor e and frequency ratio d as defined in Definition \1.2t 


M 

m = £ a k (t) cos 0 k (t)+ r(t), ak cos Ok £ U e , a k = 0(1), r = 0(e). 

fc =1 


Suppose further that d > M' 2 , and that there exists l £ 1,M such that 
\\ak cos Ok\\ < ||ajcos0z||, Vfc e 1 ,M,k ± l. 

If 

p(a,0) < p(ai,8i), 

where p(a,0) is given in ( ] /£ [ ) . then we have 

||acos0 — ai cos0 ;||^2 


||«z cos 0 i \\ L 2 


= 0(Ve). 


Proof. First, we claim that, for each k £ 1,M, 

p(a k ,O k ) = H/IH 2 - ||dfccos0fc ||^2 + 0(e). 
Granting this, it follows from (13.261) that 

p(a k ,O k ) > p(ai,Oi) Mkf^l. 


(3.26) 

(3.27) 

(3.28) 

(3.29) 

(3.30) 


To show (13.291) . we notice that 


p(a k ,O k ) = || f - a k cos0 fc ||| 2 

= 11 / 111,2 + ||afc cos 0 k \\ 2 L 2 - 2(a k cos 6 k + ^ a k > cos 6 k > +r(t),a k cos 0 k ) 

k’^k 

= 11 / 111,2 - ||ofc cos 0 fe ||^2 -2(^ ak ' cos °k' +r(t),a k cos 0 k ). 

k'^k 


By Lemma IQ we get 


(3.31) 


(a k - cos 0 k >, a k cos 0 k ) = 0(e) 


(3.32) 


for each k' ^ k. By the assumption in Definition 11.21 we have r(t) = 0(e ), which implies 


(r(t), a k cos 6 k ) = 0(e). 


(3.33) 


Substituting (13.321) and (13.331) into (13.311) proves (13.291) . 
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Let a := jp (so a > 1) and let 


min • Him 
1 <k<M 

Let fc 0 be such that a ko = ct m i n . We Claim that 

(1) If k 0 > 1 , 


e'(t) 



k = 

1 








M 

8'(t) > 



k = 

M 

(3.34) 

: te[o,i] 

e’(t) 

■ “axtefl),!] ), 

1 < 

k < M 


}• 





(3.35) 


(2) If fc 0 < K, 


1 -iW 

m 


> a, Vt £ [0, 1 ]. 


> a, 


Vi £ [0,1]. 


(3.36) 


(3.37) 


We prove item ( 1 ) by contradiction. Assume that there exists t\ £ [0,1] such that 


°' k0 Si) 


< a. 


(3.38) 


Then for any 1 £ [0,1], we have 


m 

°' ko -i (t) 


0'(h) 




< M ' 2a = M'Vd. 

%-iW 


On the other hand, (13.3811 also implies that 


(3.39) 


VJM) 

O'ih) 


W ( Q'(ti) 


-1 

>-= M'Vd. 

a 


Using (|3.39j) . (I3.4()[) . and the following estimates 


^fco-l(*l) < 1 gfcpftl) gfcpftl) 

0'(ti) - d ' 0'(ti) e'(ii) ’ 


we get 


on co-l < 


max 

te[o,i] 



— Otk 0 ■ 


(3.40) 


(3.41) 


(3.42) 


This contradicts ak 0 = ot m in ■ So item ( 1 ) is satisfied. Similarly we can show that item (2) is 
true. 

It follows from (13.271) and (13.301) that 


P(a,9) <p(a ko ,9 ko ). (3.43) 

Using Theorem 13. II bv replacing condition (13.31) by (13.251) in Remark l3Jl we obtain that 

||acos 6 » - a ko cos 6» feo || L 2 


I a/co cos 9k 0 \\l 2 


= 0(V~e). 


(3.44) 


15 





























This implies 


||acos0 - a ko cosd ko \\ L 2 = 0 (y/e). 


(3.45) 


Therefore we obtain 


b(M) -P(a ko ,0 ko )| 

=||«fe 0 cos 9 ko - a cos 6*11^2 + 2 

=0(V~e), 


(a ko cos 0 ko - a cos 0, ^ a k cos 0 k + r(t)) 

k^ko 


(3.46) 


where the first equality is deduced using an argument similar to the equalities in (13. 61) . and the 
second one follows from (13.451) . So by (13.271) . we see that ko = l and a k > cq for all k ^ l. Thus 
(13.44[) implies (13.281) . This completes the proof. 


□ 


The condition that d > M ' 2 is very strong when M' is big. However, if this condition is 
violated, the global minimizer to the P 2 problem may not be any of the IMFs in the sparsest 
representation. For example, let us consider an artificial signal /(f) defined as follows: 


/ (t) =ai (t) cos 9 1 (t) + a 2 (t) cos 62 (f), t G [0,6], 


where a±(t) 


2 + 1 , 


' lOnt 

20tt + 10tt( t - 2) + ^f(t - 2) 3 
50tt + 207r(t - 4) - ^(t — 4) 3 
50tt + 207r(f - 4) 


02 (f) = 8 — f, 0 2 (f) = 201 (f). 


f G [0,2] 
f G [2,3] 
f G [3,4] 
f G [4,6] 


(3.47) 


Here we see that d = M' = 2. Moreover, it is easy to verify that 


a'i(f) 

1 

< 

0i'(f) 

1 

< 

4(f) 

^ 1 


m 

“ 10tt’ 


“ 10tt’ 

m 

“ 20tt’ 



Vf G [0,6], 


(3.48) 


So a 1 (f) cos 0i (f) and a 2 (f) cos 0 2 (f) are well separated and both satisfy the scale separation 
property on the time domain [0,6]. If we attempt to solve the problem dP 2 D with parameter 
e = we will find that the solution (a,0) with 


a(f) = max{ai(f), a 2 (f)} = 5 + |f — 3], 0(f) = 207rf (3.49) 


is better than (ai,0i) or (a 2 ,0 2 ) (here we note that (a, 0) is obtained by simply connecting the 
left part of ( 02 , 02 ) and the right part of (oi,0i)). In fact, numerical estimation gives us that 

P(M) = II/(*) - a(f)cos0(f)|| L 2 w 72.4, 

p(ai,0i) = ||a 2 cos0 2 IIz, 2 ~ 84, (3.50) 

p(a 2 ,0 2 ) = ||ai cos0i||^2 « 84. 

Thus if d < M' 2 , mode mixing may occur. 

However, Theorem 13.21 is still helpful for us even if the condition that d > M ' 2 is violated. 

M 

Consider the signal /(f) = ^ a k (t) cos 9 k (t) + r(f) on [0,1]. We could partition the whole time 

fc= 1 
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domain [0,1] into m subintervals [■£*_i, <*] (i = 1,..., m), where 0 = to < G < • • • < t m = 1, and 
on each subinterval, we have 


su Pte[ti-i,ti] r-j 


k 


1,2,... ,M. 


(3.51) 


So we could find each IMF on each subinterval efficiently, and connect different parts of each 
IMF together. This is the basic idea of the upcoming work of the authors: Two-level method 
in sparse time-frequency representation of multiscale data. 


4 Concluding Remarks 

In this paper, we discussed the uniqueness of the decomposition obtained by the sparse time 
frequency decomposition. We proved that under the assumption of scale separation, the decom¬ 
position is unique up to an error associate with the scale separation. Moreover, we showed that 
under the same assumption, nonlinear matching pursuit could be used to obtain this sparse de¬ 
composition. The results in this paper establish a solid foundation for the sparse time frequency 
decomposition. 

In our future work, we would like to relax some of the assumptions of scale separation. In 
many problems, the decompositions seem to be unique although the scale separation is not 
satisfied. We plan to perform further theoretical study and get some guidance to decompose 
signals with poor scale separation. 
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1318377, an AFOSR MURI Grant FA9550-09-1-0613 and a DOE grant DE-FG02-06ER25727. 
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Appendix A: Proof of Lemma 12.11 


Proof, of Lemma \2.1\ 
First, we have that 


— / e -iu6'{t)z 


V'M'(f)) = / e 
Jr 

Using this relation, we obtain 

' t — t 


^(z)dz = 


^(f) 


dz. 


(A.l) 


1 

y/w 

1 


a(r)e 


dr — |w| 1//2 a(f)e l6 ^ip{oj6'(t)) 
t — t s 


[ (a(r) - a(f))e" ie(r V ( ^ ) dr + a(t) f (e" l0(r) - e -<(®(*)+«'(t)(T-t)))^ 

JR V U J JR 


T — t 


dr 


(A.2) 
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For the first term, we have 


M" 1/2 [ (a(r) - 
Jr 

M- 1 / 2 [ h(r, t)e~ ze ^dr 
Jr 


r — t 


dr 


= —i\uj 


-1/2 f ( h(T,t) V , 


where 


0'(r) 

/i(T,t) = (a(r) - a(t))^ 


*e(T) d7 


r — t 


Direct calculation gives that 


h(r, t)V a'(r) / r — t\ a(r) — a(i) 1 , / r — A /i(r, t)6"(r) 


0 '(t) J uo 


+ 


0 '(t) IjO^ \ lj 


(O'ir)) 2 


Using the assumption that (a, 9) & U e , we have 


a,(T) <e m<e, 


0'( 7 


(W) 


2 — 


and 


a(r) — a(f) 


a'(t T )(T - 1 ) 


9'(tr) 

a , (t r )(r - t) 

6 '(t) 


6 '(t) 


6»'(r) 

9'(t T ) 


< M'ejr — 1 \, 


(A.3) 


(A.4) 


(A.5) 


(A.6) 


where t T is a point between t and r. Then, we obtain 




1 — 1/2 


(o(r) - a(t))e" ie ( r V 


T — t 


dr 


< e^l 1 / 2 [(A + \a(t)\ + l)Ji + M'I 2 \, (A.7) 


where A = sup (gR |o(i)| and 

h = I ltH r )l d U h = I |T^ , (r)|dr. 


(A.8) 


Now, we turn to bound the second term of (1A.2I) . We have 


M 


- 1 / 2 / ( e ~ ie ( r ) _ f >- i ( e ( t )+ e '( t )( r ~ 


— e 


I 1/2 / ff(T,*)e * e(r) dr 
*/R 


r — t 


dr 


= —l\UJ 


- 1/2 f ( g(r,t) \\_ 


where 


0'(t) 

g(r,t) = { l-e iA > 


ie(r) dT 


r — £ 


(A.9) 


and A0 = 0 (t) — 9(t) — Q'(t)(r — t). 
Direct calculations show that 


fsMA _ l(9'(r)-9 f (t)) lAe(T , t} (T-t\ 1 

\e'{r)) ~ 9 >{t) u, ) + e>(rJ L { u ) 

g{T,t)0"{r) 


(O'(r)y 


(A.10) 
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Among the three terms, the third one is easiest to bound. We have 


g{T,t)e"(r) 


( 0 '( r )) 2 


< 2e 




T — t 


UJ 


(A.ll) 


It follows that 


' 9(r,t)e"(r) i0( T ) d 

i 

To bound the other two terms, we need some preparations. 
First, by using the assumption 


( 1 V 


9" 



to 


the above inequality from t to r as follows 

1 1 


0'(t) O' {t) 

which gives that 

\9'{t) — O' it) | < eO' {t)Q' (t)\r — t\, Vi, r G R. 
We now estimate 11 — | in two different ways, 

e -*A e(r,t) _ ^ 


< 2e / |^>(r)|dr = 2/ie. (A.12) 

Jr 

parations. 

< e, we can bound |0'(t) — O' {t)\ by integrating 
< e|r — f|, (A.13) 


(A. 14) 


< |A0(r,i)| < \0'{t*)-0'{i)\\t-T\<e0'{t)0'{t*)\t-T\ 2 

< M' eO'( t)O'( t)\t - t| 2 , (A.15) 

where t* is a number between t and r. And also 
e -iA0(r,t) _ ^ 


< |A0(t, i)| < |0'(t*) — 0'(t)||t — r| < ( sup 0'{t) — inf O' it) I \t — r| 

\teR teR ) 

< (M' — 1) ^inf 0'(t)^ |t — t| < {M' — l)0'{t)\t — t\. (A.16) 


The first term can be estimated as follows, 

' t — t 


i(0'(T)-0'(t))_ eiAe 


1 - 


0'{r) 

m 

6'{t) 


O'it) 


< 


0"(t) 


1 - 


V’ 


m 

0'(t) 

T — t 


T — t 


-^(T) d7 


UJ 


L0 

iO' (t)(r-t) ^ 




T — t 


e ie'(t)(r-t) dr 


e i8'(t)(T-t) dl 


< eM 


[O'irW 

|V'('r)|dr+ [ \tiI>' 


l f O' (t) - O' jt) , (r-t 

Wr o'{t)o'{r) v 


E ie'(t)(r-t) d7 


< |w|(/i +/ 2 )e . 


(A.17) 


The second equality is obtained by integration by parts. To get the second inequality, we use 


the assumptions that 


e"(r) 

W^W 


< e and (OCTl . 

Now, we turn to estimate the second term. Let < 72 (t, t) = ^Ay(l —e lAe ( T ’ t i)i'0 / {j~0r)- First, 
using the fact that A 0(t, t) = 0(t) — 0(t) — 0'(t)(r — t), we have 


f g2ir,t)e- ie ^dT = e~^ [ 

JR JR 


e -iA9(r,t)_ 1 / T _ t \ 


u>0'{t) 




iu 


0'{t) 


e -*A9(r,t)_ 1 ( T -t 

■*l> 


w0'(r) 


UJ 


-iO'(i)(T- t)j 7 


e -ie' ( t)( T -i )dr 


, (A.18) 
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and 


m 


S -*A 8(r,t)_ 1 f T - t 


U)0'(t) 


UJ 


9"{t) (e-^(r,0-i) ^ ( T -t\ _ »(y(r)-y(t)) __ iA9fr , 0 ,, f r-i 


(6>'(t)) 2 wfl'(i) 

e -iAe(r,t) _ 1 ( T -t 

+ 0 „., ^ 


w6» , (r)6» , (t) 


*y 


u 2 9'(r)9'(t) \ ui 

Then, (IA.18I) can be bounded term by term as follows: 


using (1A.16I) . 
using (I A. 1411 . 

using (1A.15D . 


9"(t) ( e -iAe(r,t) _ i \ f T _ t 

-ip 


(9'(t)) 2 uj9'(t) 

i(8'(T) - 8'{t)) ^ lAe(T , t) ^ ( r-t 


uj9'{t)9' (t) 

3 — iA0(r,t) _ ^ 


< (M' - l)e 

< e 


T-t , (T-t 

—Ip 


T-t , T-t 

- Ip 


-r 


T — t 


UJ 


< M'e 


T — t 


UJ 


uj 2 6' (r)O'(t) 

By combining these inequalities, (|A.20I) . (|A.21I) and (|A.22|) . we get 


r 


UJ 

T — t 
UJ 


f 92(T,t)e * e(r) d t 

Jr 


< M'\uj\(I 2 + h)e, 


where 


h = f \t 2 ip"( t)\&t. 

Jr 

Then the proof is completed by combining (IA.7D , (IA.12[) , (1A. 171) and (IA.23I) . 


(A.19) 

(A.20) 
(A.21) 

(A.22) 

(A.23) 

(A.24) 

□ 


Appendix B: Proof of Lemma 13.11 


To prove Lemma 13. 11 we need the following technical lemma. 

Lemma B.l. Let e £ (0,1) and g(t ) be a positive, continuous, and piecewise C 1 function on 
[c, c + 2n7r], where n is an integer. Suppose 


9'(t) 


g(t) 


< e, Vi £ [c, d). 


Then we have 


/*c+2n7r 


g(t) cos tdt 


f>c-\-2mv 


< 27re / g(t)dt. 


(B.l) 


(B.2) 
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Proof. For each m £ { 0,1, 2, • • • , n}, let t m = c + 2mn. We have 


/»C+2ri7T 'I rim 'I rim 

/ g[t)costdt = ^ / g(t) cos tdt = E [sW - 9 (t m -i)]costdt 

«/ C ™_i v tm, _1 i™_i u tm _1 


V r t. 


a=l U lm-l 
V r t. 


V ptrr 


%=1 ^lm -1 


V pt. 


tm -1 W*77 


= E 

m=l 
V 

< E / i cos *i 


g'(s)ds ] cos tdt 


< 


l =l' JZ rn-l 


f (/" 

m=l V^m-l 


costjdf 


|g'(s)| ds dt 


eg{s)ds 


m= 1 
V 


= E 4e / 


m—1 


= 4e 


c+2n7r 


g{s)ds. 


We complete the proof. 

Now, we can give the proof of Lemma 13.11 


Proof, of Lemma \S.l\ 

First, using cos 2 (d) = (1 + cos(20))/2, we get 


□ 


\\a(t) cos0(t )\\ 2 L 2 = ^\\a(t)\\ 2 L 2 + ^ J a 2 {t) cos 26{t)dt. (B.3) 


Let s = 2 8(t). Then we obtain 

/•i i 

/ a 2 (t) cos 26(t)dt = - / g(s)cossds, 
do 2 J 26 fo) 


where t(s) := 0 1 (|) and 


5(«) “ ~m 


(*(«)) 


W)) ■ 


So the derivative of g is 


Hence we get 


, = a(t(s))a' (t(s)) _ a 2 (t(s)) • 6>"(f(s)) 

9 [ ’ TO*))] 2 2[0'(i( a ))]3 ■ 


g'(s) 


«'(*(«)) 

*"(*(«)) 

g(s) 


a(t(s)) • 6'{t{s)) 

2[6'{t{s))} 2 


<-e, Vs G [20(0), 20(1)]. 


Using Lemma lB.il we obtain 


a 2 {t) cos 2 9(t)dt 


,28(1) ,1 

< 3e / g(s)ds = 6e / a 2 {t)dt. 

J 26(0) Jo 


The above estimate and (IB. 31) imply (13.161) . 


(B.4) 


(B.5) 


(B.6) 


(B.7) 


(B.8) 
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To prove (13.181) . we represent the inner product in this inequality as follows: 


(a cos 9, a cos 9) = 


a(t)a(t) cos (9(f) + 9(t))dt + / a(t)a(t) cos (9(t) — 9(t))dt 

Uo Jo 


Let s = 9(f) — 9(f). We obtain 

f a(t)a(t) cos (9(f) — 9(t))dt = 

Jo 

where t(s) = (9 — 0) _1 (s) and 


'0( o)-e(Q) 


g(s) cos sds, 


g(s) = 


_ a(t(s))a{t(s)) 

9'{t{s)) - 9 r (t{s))' 


Thus, we have 


and 


s'O) 


g(s) 


d (O' — 9')(aa' + a' a) — aa(9" — 9") 

ds 9S ~ (i 9'(t(s))-9'(t(s ))) 3 

Vs e [0(0) -9(0), 9(1) -0(1)]. 


< 


2 e 


( 1 -/ 3 - 1 ) 2 ’ 


Using Lemma [BT] again, we get 


a(t)a(t) cos (9(t) — 9(t))dt 


'o 

Similarly, we can show 

r*l 


86 f L 

< ( 1 _ /3 -i) 2 ^ a(t)a(t)dt. 


a(t)a(t) cos(9(t) + 9(t))dt 


io 


< + ^^ [ a(t)a(t)dt < 8e f a(t)a(t)dt 

(1 + P) Jo Jo 


Thus (13.181) follows by combining (IB. 91) . (IB.141) and (IB. 151) . 


(B.9) 

(B.10) 

(B.ll) 

(B.12) 

(B.13) 

(B.14) 

(B.15) 

□ 
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